Clinical acceptability of automatically generated lymph node levels and structures of deglutition and mastication for head and neck radiation therapy.

Background and Purpose: Auto-contouring of complex anatomy in computed tomography (CT) scans is a highly anticipated solution to many problems in radiotherapy. In this study, artificial intelligence (AI)-based auto-contouring models were clinically validated for lymph node levels and structures of swallowing and chewing in the head and neck. Materials and Methods: CT scans of 145 head and neck radiotherapy patients were retrospectively curated. One cohort (n = 47) was used to analyze seven lymph node levels and the other (n = 98) used to analyze 17 swallowing and chewing structures. Separate nnUnet models were trained and validated using the separate cohorts. For the lymph node levels, preference and clinical acceptability of AI vs human contours were scored. For the swallowing and chewing structures, clinical acceptability was scored. Quantitative analyses of the test sets were performed for AI vs human contours for all structures using overlap and distance metrics. Results: Median Dice Similarity Coefficient ranged from 0.77 to 0.89 for lymph node levels and 0.86 to 0.96 for chewing and swallowing structures. The AI contours were superior to or equally preferred to the manual contours at rates ranging from 75% to 91%; there was not a significant difference in clinical acceptability for nodal levels I-V for manual versus AI contours. Across all AI-generated lymph node level contours, 92% were rated as usable with stylistic to no edits. Of the 340 contours in the chewing and swallowing cohort, 4% required minor edits. Conclusions: An accurate approach was developed to auto-contour lymph node levels and chewing and swallowing structures on CT images for patients with intact nodal anatomy. Only a small portion of test set auto-contours required minor edits.

Monitoring Variations in the Use of Automated Contouring Software.

PURPOSE: Our purpose was to identify variations in the clinical use of automatically generated contours that could be attributed to software error, off-label use, or automation bias. METHODS AND MATERIALS: For 500 head and neck patients who were contoured by an in-house automated contouring system, Dice similarity coefficient and added path length were calculated between the contours generated by the automated system and the final contours after editing for clinical use. Statistical process control was used and control charts were generated with control limits at 3 standard deviations. Contours that exceeded the thresholds were investigated to determine the cause. Moving mean control plots were then generated to identify dosimetrists who were editing less over time, which could be indicative of automation bias. RESULTS: Major contouring edits were flagged for: 1.0% brain, 3.1% brain stem, 3.5% left cochlea, 2.9% right cochlea, 4.8% esophagus, 4.1% left eye, 4.0% right eye, 2.2% left lens, 4.9% right lens, 2.5% mandible, 11% left optic nerve, 6.1% right optic nerve, 3.8% left parotid, 5.9% right parotid, and 3.0% of spinal cord contours. Identified causes of editing included unexpected patient positioning, deviation from standard clinical practice, and disagreement between dosimetrist preference and automated contouring style. A statistically significant (P < .05) difference was identified between the contour editing practice of dosimetrists, with 1 dosimetrist editing more across all organs at risk. Eighteen percent (27/150) of moving mean control plots created for 5 dosimetrists indicated the amount of contour editing was decreasing over time, possibly corresponding to automation bias. CONCLUSIONS: The developed system was used to detect statistically significant edits caused by software error, unexpected clinical use, and automation bias. The increased ability to detect systematic errors that occur when editing automatically generated contours will improve the safety of the automatic treatment planning workflow.

Deep learning-based automatic segmentation of cardiac substructures for lung cancers.

PURPOSE: Accurate and comprehensive segmentation of cardiac substructures is crucial for minimizing the risk of radiation-induced heart disease in lung cancer radiotherapy. We sought to develop and validate deep learning-based auto-segmentation models for cardiac substructures. MATERIALS AND METHODS: Nineteen cardiac substructures (whole heart, 4 heart chambers, 6 great vessels, 4 valves, and 4 coronary arteries) in 100 patients treated for non-small cell lung cancer were manually delineated by two radiation oncologists. The valves and coronary arteries were delineated as planning risk volumes. An nnU-Net auto-segmentation model was trained, validated, and tested on this dataset with a split ratio of 75:5:20. The auto-segmented contours were evaluated by comparing them with manually drawn contours in terms of Dice similarity coefficient (DSC) and dose metrics extracted from clinical plans. An independent dataset of 42 patients was used for subjective evaluation of the auto-segmentation model by 4 physicians. RESULTS: The average DSCs were 0.95 (+/- 0.01) for the whole heart, 0.91 (+/- 0.02) for 4 chambers, 0.86 (+/- 0.09) for 6 great vessels, 0.81 (+/- 0.09) for 4 valves, and 0.60 (+/- 0.14) for 4 coronary arteries. The average absolute errors in mean/max doses to all substructures were 1.04 (+/- 1.99) Gy and 2.20 (+/- 4.37) Gy. The subjective evaluation revealed that 94% of the auto-segmented contours were clinically acceptable. CONCLUSION: We demonstrated the effectiveness of our nnU-Net model for delineating cardiac substructures, including coronary arteries. Our results indicate that this model has promise for studies regarding radiation dose to cardiac substructures.

Fully-automated, CT-only GTV contouring for palliative head and neck radiotherapy.

Planning for palliative radiotherapy is performed without the advantage of MR or PET imaging in many clinics. Here, we investigated CT-only GTV delineation for palliative treatment of head and neck cancer. Two multi-institutional datasets of palliative-intent treatment plans were retrospectively acquired: a set of 102 non-contrast-enhanced CTs and a set of 96 contrast-enhanced CTs. The nnU-Net auto-segmentation network was chosen for its strength in medical image segmentation, and five approaches separately trained: (1) heuristic-cropped, non-contrast images with a single GTV channel, (2) cropping around a manually-placed point in the tumor center for non-contrast images with a single GTV channel, (3) contrast-enhanced images with a single GTV channel, (4) contrast-enhanced images with separate primary and nodal GTV channels, and (5) contrast-enhanced images along with synthetic MR images with separate primary and nodal GTV channels. Median Dice similarity coefficient ranged from 0.6 to 0.7, surface Dice from 0.30 to 0.56, and 95th Hausdorff distance from 14.7 to 19.7 mm across the five approaches. Only surface Dice exhibited statistically-significant difference across these five approaches using a two-tailed Wilcoxon Rank-Sum test (p ≤ 0.05). Our CT-only results met or exceeded published values for head and neck GTV autocontouring using multi-modality images. However, significant edits would be necessary before clinical use in palliative radiotherapy.

Radiation Planning Assistant - A Web-based Tool to Support High-quality Radiotherapy in Clinics with Limited Resources.

Access to radiotherapy worldwide is limited. The Radiation Planning Assistant (RPA) is a fully automated, web-based tool that is being developed to offer fully automated radiotherapy treatment planning tools to clinics with limited resources. The goal is to help clinical teams scale their efforts, thus reaching more patients with cancer. The user connects to the RPA via a webpage, completes a Service Request (prescription and information about the radiotherapy targets), and uploads the patient's CT image set. The RPA offers two approaches to automated planning. In one-step planning, the system uses the Service Request and CT scan to automatically generate the necessary contours and treatment plan. In two-step planning, the user reviews and edits the automatically generated contours before the RPA continues to generate a volume-modulated arc therapy plan. The final plan is downloaded from the RPA website and imported into the user's local treatment planning system, where the dose is recalculated for the locally commissioned linac; if necessary, the plan is edited prior to approval for clinical use.

Validation of an automated contouring and treatment planning tool for pediatric craniospinal radiation therapy.

Purpose: Treatment planning for craniospinal irradiation (CSI) is complex and time-consuming, especially for resource-constrained centers. To alleviate demanding workflows, we successfully automated the pediatric CSI planning pipeline in previous work. In this work, we validated our CSI autosegmentation and autoplanning tool on a large dataset from St. Jude Children's Research Hospital. Methods: Sixty-three CSI patient CT scans were involved in the study. Pre-planning scripts were used to automatically verify anatomical compatibility with the autoplanning tool. The autoplanning pipeline generated 15 contours and a composite CSI treatment plan for each of the compatible test patients (n=51). Plan quality was evaluated quantitatively with target coverage and dose to normal tissue metrics and qualitatively with physician review, using a 5-point Likert scale. Three pediatric radiation oncologists from 3 institutions reviewed and scored 15 contours and a corresponding composite CSI plan for the final 51 test patients. One patient was scored by 3 physicians, resulting in 53 plans scored total. Results: The algorithm automatically detected 12 incompatible patients due to insufficient junction spacing or head tilt and removed them from the study. Of the 795 autosegmented contours reviewed, 97% were scored as clinically acceptable, with 92% requiring no edits. Of the 53 plans scored, all 51 brain dose distributions were scored as clinically acceptable. For the spine dose distributions, 92%, 100%, and 68% of single, extended, and multiple-field cases, respectively, were scored as clinically acceptable. In all cases (major or minor edits), the physicians noted that they would rather edit the autoplan than create a new plan. Conclusions: We successfully validated an autoplanning pipeline on 51 patients from another institution, indicating that our algorithm is robust in its adjustment to differing patient populations. We automatically generated 15 contours and a comprehensive CSI treatment plan for each patient without physician intervention, indicating the potential for increased treatment planning efficiency and global access to high-quality radiation therapy.

Identifying the optimal deep learning architecture and parameters for automatic beam aperture definition in 3D radiotherapy.

PURPOSE: Two-dimensional radiotherapy is often used to treat cervical cancer in low- and middle-income countries, but treatment planning can be challenging and time-consuming. Neural networks offer the potential to greatly decrease planning time through automation, but the impact of the wide range of hyperparameters to be set during training on model accuracy has not been exhaustively investigated. In the current study, we evaluated the effect of several convolutional neural network architectures and hyperparameters on 2D radiotherapy treatment field delineation. METHODS: Six commonly used deep learning architectures were trained to delineate four-field box apertures on digitally reconstructed radiographs for cervical cancer radiotherapy. A comprehensive search of optimal hyperparameters for all models was conducted by varying the initial learning rate, image normalization methods, and (when appropriate) convolutional kernel size, the number of learnable parameters via network depth and the number of feature maps per convolution, and nonlinear activation functions. This yielded over 1700 unique models, which were all trained until performance converged and then tested on a separate dataset. RESULTS: Of all hyperparameters, the choice of initial learning rate was most consistently significant for improved performance on the test set, with all top-performing models using learning rates of 0.0001. The optimal image normalization was not consistent across architectures. High overlap (mean Dice similarity coefficient = 0.98) and surface distance agreement (mean surface distance < 2 mm) were achieved between the treatment field apertures for all architectures using the identified best hyperparameters. Overlap Dice similarity coefficient (DSC) and distance metrics (mean surface distance and Hausdorff distance) indicated that DeepLabv3+ and D-LinkNet architectures were least sensitive to initial hyperparameter selection. CONCLUSION: DeepLabv3+ and D-LinkNet are most robust to initial hyperparameter selection. Learning rate, nonlinear activation function, and kernel size are also important hyperparameters for improving performance.

Automated contouring and statistical process control for plan quality in a breast clinical trial.

Background and purpose: Automatic review of breast plan quality for clinical trials is time-consuming and has some unique challenges due to the lack of target contours for some planning techniques. We propose using an auto-contouring model and statistical process control to independently assess planning consistency in retrospective data from a breast radiotherapy clinical trial. Materials and methods: A deep learning auto-contouring model was created and tested quantitatively and qualitatively on 104 post-lumpectomy patients' computed tomography images (nnUNet; train/test: 80/20). The auto-contouring model was then applied to 127 patients enrolled in a clinical trial. Statistical process control was used to assess the consistency of the mean dose to auto-contours between plans and treatment modalities by setting control limits within three standard deviations of the data's mean. Two physicians reviewed plans outside the limits for possible planning inconsistencies. Results: Mean Dice similarity coefficients comparing manual and auto-contours was above 0.7 for breast clinical target volume, supraclavicular and internal mammary nodes. Two radiation oncologists scored 95% of contours as clinically acceptable. The mean dose in the clinical trial plans was more variable for lymph node auto-contours than for breast, with a narrower distribution for volumetric modulated arc therapy than for 3D conformal treatment, requiring distinct control limits. Five plans (5%) were flagged and reviewed by physicians: one required editing, two had clinically acceptable variations in planning, and two had poor auto-contouring. Conclusions: An automated contouring model in a statistical process control framework was appropriate for assessing planning consistency in a breast radiotherapy clinical trial.

A real-time contouring feedback tool for consensus-based contour training.

Purpose: Variability in contouring structures of interest for radiotherapy continues to be challenging. Although training can reduce such variability, having radiation oncologists provide feedback can be impractical. We developed a contour training tool to provide real-time feedback to trainees, thereby reducing variability in contouring. Methods: We developed a novel metric termed localized signed square distance (LSSD) to provide feedback to the trainee on how their contour compares with a reference contour, which is generated real-time by combining trainee contour and multiple expert radiation oncologist contours. Nine trainees performed contour training by using six randomly assigned training cases that included one test case of the heart and left ventricle (LV). The test case was repeated 30 days later to assess retention. The distribution of LSSD maps of the initial contour for the training cases was combined and compared with the distribution of LSSD maps of the final contours for all training cases. The difference in standard deviations from the initial to final LSSD maps, ΔLSSD, was computed both on a per-case basis and for the entire group. Results: For every training case, statistically significant ΔLSSD were observed for both the heart and LV. When all initial and final LSSD maps were aggregated for the training cases, before training, the mean LSSD ([range], standard deviation) was -0.8 mm ([-37.9, 34.9], 4.2) and 0.3 mm ([-25.1, 32.7], 4.8) for heart and LV, respectively. These were reduced to -0.1 mm ([-16.2, 7.3], 0.8) and 0.1 mm ([-6.6, 8.3], 0.7) for the final LSSD maps during the contour training sessions. For the retention case, the initial and final LSSD maps of the retention case were aggregated and were -1.5 mm ([-22.9, 19.9], 3.4) and -0.2 mm ([-4.5, 1.5], 0.7) for the heart and 1.8 mm ([-16.7, 34.5], 5.1) and 0.2 mm ([-3.9, 1.6],0.7) for the LV. Conclusions: A tool that uses real-time contouring feedback was developed and successfully used for contour training of nine trainees. In all cases, the utility was able to guide the trainee and ultimately reduce the variability of the trainee's contouring.

Addressing the Global Expertise Gap in Radiation Oncology: The Radiation Planning Assistant.

PURPOSE: Automation, including the use of artificial intelligence, has been identified as a possible opportunity to help reduce the gap in access and quality for radiotherapy and other aspects of cancer care. The Radiation Planning Assistant (RPA) project was conceived in 2015 (and funded in 2016) to use automated contouring and treatment planning algorithms to support the efforts of oncologists in low- and middle-income countries, allowing them to scale their efforts and treat more patients safely and efficiently (to increase access). DESIGN: In this review, we discuss the development of the RPA, with a particular focus on clinical acceptability and safety/risk across jurisdictions as these are important indicators for the successful future deployment of the RPA to increase radiotherapy availability and ameliorate global disparities in access to radiation oncology. RESULTS: RPA tools will be offered through a webpage, where users can upload computed tomography data sets and download automatically generated contours and treatment plans. All interfaces have been designed to maximize ease of use and minimize risk. The current version of the RPA includes automated contouring and planning for head and neck cancer, cervical cancer, breast cancer, and metastases to the brain. CONCLUSION: The RPA has been designed to bring high-quality treatment planning to more patients across the world, and it may encourage greater investment in treatment devices and other aspects of cancer treatment.

Resection cavity auto-contouring for patients with pediatric medulloblastoma using only CT information.

PURPOSE: Target delineation for radiation therapy is a time-consuming and complex task. Autocontouring gross tumor volumes (GTVs) has been shown to increase efficiency. However, there is limited literature on post-operative target delineation, particularly for CT-based studies. To this end, we trained a CT-based autocontouring model to contour the post-operative GTV of pediatric patients with medulloblastoma. METHODS: One hundred four retrospective pediatric CT scans were used to train a GTV auto-contouring model. Eighty patients were then preselected for contour visibility, continuity, and location to train an additional model. Each GTV was manually annotated with a visibility score based on the number of slices with a visible GTV (1 = < 25%, 2 = 25-50%, 3 = > 50-75%, and 4 = > 75-100%). Contrast and the contrast-to-noise ratio (CNR) were calculated for the GTV contour with respect to a cropped background image. Both models were tested on the original and pre-selected testing sets. The resulting surface and overlap metrics were calculated comparing the clinical and autocontoured GTVs and the corresponding clinical target volumes (CTVs). RESULTS: Eighty patients were pre-selected to have a continuous GTV within the posterior fossa. Of these, 7, 41, 21, and 11 were visibly scored as 4, 3, 2, and 1, respectively. The contrast and CNR removed an additional 11 and 20 patients from the dataset, respectively. The Dice similarity coefficients (DSC) were 0.61 ± 0.29 and 0.67 ± 0.22 on the models without pre-selected training data and 0.55 ± 13.01 and 0.83 ± 0.17 on the models with pre-selected data, respectively. The DSC on the CTV expansions were 0.90 ± 0.13. CONCLUSION: We successfully automatically contoured continuous GTVs within the posterior fossa on scans that had contrast > ± 10 HU. CT-Based auto-contouring algorithms have potential to positively impact centers with limited MRI access.

Automated Contouring and Planning in Radiation Therapy: What Is 'Clinically Acceptable'?

Developers and users of artificial-intelligence-based tools for automatic contouring and treatment planning in radiotherapy are expected to assess clinical acceptability of these tools. However, what is 'clinical acceptability'? Quantitative and qualitative approaches have been used to assess this ill-defined concept, all of which have advantages and disadvantages or limitations. The approach chosen may depend on the goal of the study as well as on available resources. In this paper, we discuss various aspects of 'clinical acceptability' and how they can move us toward a standard for defining clinical acceptability of new autocontouring and planning tools.

Automating the treatment planning process for 3D-conformal pediatric craniospinal irradiation therapy.

PURPOSE: Pediatric patients with medulloblastoma in low- and middle-income countries (LMICs) are most treated with 3D-conformal photon craniospinal irradiation (CSI), a time-consuming, complex treatment to plan, especially in resource-constrained settings. Therefore, we developed and tested a 3D-conformal CSI autoplanning tool for varying patient lengths. METHODS AND MATERIALS: Autocontours were generated with a deep learning model trained:tested (80:20 ratio) on 143 pediatric medulloblastoma CT scans (patient ages: 2-19 years, median = 7 years). Using the verified autocontours, the autoplanning tool generated two lateral brain fields matched to a single spine field, an extended single spine field, or two matched spine fields. Additional spine subfields were added to optimize the corresponding dose distribution. Feathering was implemented (yielding nine to 12 fields) to give a composite plan. Each planning approach was tested on six patients (ages 3-10 years). A pediatric radiation oncologist assessed clinical acceptability of each autoplan. RESULTS: The autocontoured structures' average Dice similarity coefficient ranged from .65 to .98. The average V95 for the brain/spinal canal for single, extended, and multi-field spine configurations was 99.9% ± 0.06%/99.9% ± 0.10%, 99.9% ± 0.07%/99.4% ± 0.30%, and 99.9% ± 0.06%/99.4% ± 0.40%, respectively. The average maximum dose across all field configurations to the brainstem, eyes (L/R), lenses (L/R), and spinal cord were 23.7 ± 0.08, 24.1 ± 0.28, 13.3 ± 5.27, and 25.5 ± 0.34 Gy, respectively (prescription = 23.4 Gy/13 fractions). Of the 18 plans tested, all were scored as clinically acceptable as-is or clinically acceptable with minor, time-efficient edits preferred or required. No plans were scored as clinically unacceptable. CONCLUSION: The autoplanning tool successfully generated pediatric CSI plans for varying patient lengths in 3.50 ± 0.4 minutes on average, indicating potential for an efficient planning aid in a resource-constrained settings.

Automated field-in-field whole brain radiotherapy planning.

PURPOSE: We developed and tested an automatic field-in-field (FIF) solution for whole-brain radiotherapy (WBRT) planning that creates a homogeneous dose distribution by minimizing hotspots, resulting in clinically acceptable plans. METHODS: A configurable auto-planning algorithm was developed to automatically generate FIF WBRT plans independent of the treatment planning system. Configurable parameters include the definition of hotspots, target volume, maximum number of subfields, and minimum number of monitor units per field. This algorithm iteratively identifies a hotspot, creates two opposing subfields, calculates the dose, and optimizes the beam weight based on user-configured constraints of dose-volume histogram coverage and least-squared cost functions. The algorithm was retrospectively tested on 17 whole-brain patients. First, an in-house landmark-based automated beam aperture technique was used to generate the treatment fields and initial plans. Second, the FIF algorithm was employed to optimize the plans using physician-defined goals of 99.9% of the brain volume receiving 100% of the prescription dose (30 Gy in 10 fractions) and a target hotspot definition of 107% of the prescription dose. The final auto-optimized plans were assessed for clinical acceptability by an experienced radiation oncologist using a five-point scale. RESULTS: The FIF algorithm reduced the mean (± SD) plan hotspot percentage dose from 35.0 Gy (116.6%) ± 0.6 Gy (2.0%) to 32.6 Gy (108.8%) ± 0.4 Gy (1.2%). Also, it decreased the mean (± SD) hotspot V107% [cm3 ] from 959 ± 498 cm3 to 145 ± 224 cm3 . On average, plans were produced in 16 min without any user intervention. Furthermore, 76.5% of the auto-plans were clinically acceptable (needing no or minor stylistic edits), and all of them were clinically acceptable after minor clinically necessary edits. CONCLUSIONS: This algorithm successfully produced high-quality WBRT plans and can improve treatment planning efficiency when incorporated into an automatic planning workflow.

Customizable landmark-based field aperture design for automated whole-brain radiotherapy treatment planning.

PURPOSE: To develop and evaluate an automated whole-brain radiotherapy (WBRT) treatment planning pipeline with a deep learning-based auto-contouring and customizable landmark-based field aperture design. METHODS: The pipeline consisted of the following steps: (1) Auto-contour normal structures on computed tomography scans and digitally reconstructed radiographs using deep learning techniques, (2) locate the landmark structures using the beam's-eye-view, (3) generate field apertures based on eight different landmark rules addressing different clinical purposes and physician preferences. Two parallel approaches for generating field apertures were developed for quality control. The performance of the generated field shapes and dose distributions were compared with the original clinical plans. The clinical acceptability of the plans was assessed by five radiation oncologists from four hospitals. RESULTS: The performance of the generated field apertures was evaluated by the Hausdorff distance (HD) and mean surface distance (MSD) from 182 patients' field apertures used in the clinic. The average HD and MSD for the generated field apertures were 16 ± 7 and 7 ± 3 mm for the first approach, respectively, and 17 ± 7 and 7 ± 3 mm, respectively, for the second approach. The differences regarding HD and MSD between the first and the second approaches were 1 ± 2 and 1 ± 3 mm, respectively. A clinical review of the field aperture design, conducted using 30 patients, achieved a 100% acceptance rate for both the first and second approaches, and the plan review achieved a 100% acceptance rate for the first approach and a 93% acceptance rate for the second approach. The average acceptance rate for meeting lens dosimetric recommendations was 80% (left lens) and 77% (right lens) for the first approach, and 70% (both left and right lenses) for the second approach, compared with 50% (left lens) and 53% (right lens) for the clinical plans. CONCLUSION: This study provided an automated pipeline with two field aperture generation approaches to automatically generate WBRT treatment plans. Both quantitative and qualitative evaluations demonstrated that our novel pipeline was comparable with the original clinical plans.

Multi-organ segmentation of abdominal structures from non-contrast and contrast enhanced CT images.

Manually delineating upper abdominal organs at risk (OARs) is a time-consuming task. To develop a deep-learning-based tool for accurate and robust auto-segmentation of these OARs, forty pancreatic cancer patients with contrast-enhanced breath-hold computed tomographic (CT) images were selected. We trained a three-dimensional (3D) U-Net ensemble that automatically segments all organ contours concurrently with the self-configuring nnU-Net framework. Our tool's performance was assessed on a held-out test set of 30 patients quantitatively. Five radiation oncologists from three different institutions assessed the performance of the tool using a 5-point Likert scale on an additional 75 randomly selected test patients. The mean (± std. dev.) Dice similarity coefficient values between the automatic segmentation and the ground truth on contrast-enhanced CT images were 0.80 ± 0.08, 0.89 ± 0.05, 0.90 ± 0.06, 0.92 ± 0.03, 0.96 ± 0.01, 0.97 ± 0.01, 0.96 ± 0.01, and 0.96 ± 0.01 for the duodenum, small bowel, large bowel, stomach, liver, spleen, right kidney, and left kidney, respectively. 89.3% (contrast-enhanced) and 85.3% (non-contrast-enhanced) of duodenum contours were scored as a 3 or above, which required only minor edits. More than 90% of the other organs' contours were scored as a 3 or above. Our tool achieved a high level of clinical acceptability with a small training dataset and provides accurate contours for treatment planning.

An Automated Treatment Planning Framework for Spinal Radiation Therapy and Vertebral-Level Second Check.

PURPOSE: Complicating factors such as time pressures, anatomic variants in the spine, and similarities in adjacent vertebrae are associated with incorrect level treatments of the spine. The purpose of this work was to mitigate such challenges by fully automating the treatment planning process for diagnostic and simulation computed tomography (CT) scans. METHODS AND MATERIALS: Vertebral bodies are labeled on CT scans of any length using 2 intendent deep-learning models-mirroring 2 different experts labeling the spine. Then, a U-Net++ architecture was trained, validated, and tested to contour each vertebra (n = 220 CT scans). Features from the CT and auto-contours were input into a random forest classifier to predict whether vertebrae were correctly labeled. This classifier was trained using auto-contours from cone beam computed tomography, positron emission tomography/CT, simulation CT, and diagnostic CT images (n = 56 CT scans, 751 contours). Auto-plans were generated via scripting. Each model was combined into a framework to make a fully automated clinical tool. A retrospective planning study was conducted in which 3 radiation oncologists scored auto-plan quality on an unseen patient cohort (n = 60) on a 5-point scale. CT scans varied in scan length, presence of surgical implants, imaging protocol, and metastatic burden. RESULTS: The results showed that the uniquely designed convolutional neural networks accurately labeled and segmented vertebral bodies C1-L5 regardless of imaging protocol or metastatic burden. Mean dice-similarity coefficient was 85.0% (cervical), 90.3% (thoracic), and 93.7% (lumbar). The random forest classifier predicted mislabeling across various CT scan types with an area under the curve of 0.82. All contouring and labeling errors within treatment regions (11 of 11), including errors from patient plans with atypical anatomy (eg, T13, L6) were detected. Radiation oncologists scored 98% of simulation CT-based plans and 92% of diagnostic CT-based plans as clinically acceptable or needing minor edits for patients with typical anatomy. On average, end-to-end treatment planning time of the clinical tool was less than 8 minutes. CONCLUSIONS: This novel method to automatically verify, contour, and plan palliative spine treatments is efficient and effective across various CT scan types. Furthermore, it is the first to create a clinical tool that can automatically verify vertebral level in CT images.

Clinical implementation of automated treatment planning for whole-brain radiotherapy.

The purpose of the study was to develop and clinically deploy an automated, deep learning-based approach to treatment planning for whole-brain radiotherapy (WBRT). We collected CT images and radiotherapy treatment plans to automate a beam aperture definition from 520 patients who received WBRT. These patients were split into training (n = 312), cross-validation (n = 104), and test (n = 104) sets which were used to train and evaluate a deep learning model. The DeepLabV3+ architecture was trained to automatically define the beam apertures on lateral-opposed fields using digitally reconstructed radiographs (DRRs). For the beam aperture evaluation, 1st quantitative analysis was completed using a test set before clinical deployment and 2nd quantitative analysis was conducted 90 days after clinical deployment. The mean surface distance and the Hausdorff distances were compared in the anterior-inferior edge between the clinically used and the predicted fields. Clinically used plans and deep-learning generated plans were evaluated by various dose-volume histogram metrics of brain, cribriform plate, and lens. The 1st quantitative analysis showed that the average mean surface distance and Hausdorff distance were 7.1 mm (±3.8 mm) and 11.2 mm (±5.2 mm), respectively, in the anterior-inferior edge of the field. The retrospective dosimetric comparison showed that brain dose coverage (D99%, D95%, D1%) of the automatically generated plans was 29.7, 30.3, and 32.5 Gy, respectively, and the average dose of both lenses was up to 19.0% lower when compared to the clinically used plans. Following the clinical deployment, the 2nd quantitative analysis showed that the average mean surface distance and Hausdorff distance between the predicted and clinically used fields were 2.6 mm (±3.2 mm) and 4.5 mm (±5.6 mm), respectively. In conclusion, the automated patient-specific treatment planning solution for WBRT was implemented in our clinic. The predicted fields appeared consistent with clinically used fields and the predicted plans were dosimetrically comparable.

Development and dosimetric assessment of an automatic dental artifact classification tool to guide artifact management techniques in a fully automated treatment planning workflow.

PURPOSE: We conducted our study to develop a tool capable of automatically detecting dental artifacts in a CT scan on a slice-by-slice basis and to assess the dosimetric impact of implementing the tool into the Radiation Planning Assistant (RPA), a web-based platform designed to fully automate the radiation therapy treatment planning process. METHODS: We developed an automatic dental artifact identification tool and assessed the dosimetric impact of its use in the RPA. Three users manually annotated 83,676 head-and-neck (HN) CT slices (549 patients). Majority-voting was applied to the individual annotations to determine the presence or absence of dental artifacts. The patients were divided into train, cross-validation, and test data sets (ratio: 3:1:1, respectively). A random subset of images without dental artifacts was used to balance classes (1:1) in the training data set. The Inception-V3 deep learning model was trained with the binary cross-entropy loss function. With use of this model, we automatically identified artifacts on 15 RPA HN plans on a slice-by-slice basis and investigated three dental artifact management methods applied before and after volumetric modulated arc therapy (VMAT) plan optimization. The resulting dose distributions and target coverage were quantified. RESULTS: Per-slice accuracy, sensitivity, and specificity were 99 %, 91 %, and 99 %, respectively. The model identified all patients with artifacts. Small dosimetric differences in total plan dose were observed between the various density-override methods (±1 Gy). For the pre- and post-optimized plans, 90 % and 99 %, respectively, of dose comparisons resulted in normal structure dose differences of ±1 Gy. Differences in the volume of structures receiving 95 % of the prescribed dose (V95[%]) were ≤0.25 % for 100 % of plans. CONCLUSION: The dosimetric impact of applying dental artifact management before and after artifact plan optimization was minor. Our results suggest that not accounting for dental artifacts in the current RPA workflow (where only post-optimization dental artifact management is possible) may result in minor dosimetric differences. If RPA users choose to override CT densities as a solution to managing dental artifacts, our results suggest segmenting the volume of the artifact and overriding its density to water is a safe option.

Radiomics features of the primary tumor fail to improve prediction of overall survival in large cohorts of CT- and PET-imaged head and neck cancer patients.

Radiomics studies require many patients in order to power them, thus patients are often combined from different institutions and using different imaging protocols. Various studies have shown that imaging protocols affect radiomics feature values. We examined whether using data from cohorts with controlled imaging protocols improved patient outcome models. We retrospectively reviewed 726 CT and 686 PET images from head and neck cancer patients, who were divided into training or independent testing cohorts. For each patient, radiomics features with different preprocessing were calculated and two clinical variables-HPV status and tumor volume-were also included. A Cox proportional hazards model was built on the training data by using bootstrapped Lasso regression to predict overall survival. The effect of controlled imaging protocols on model performance was evaluated by subsetting the original training and independent testing cohorts to include only patients whose images were obtained using the same imaging protocol and vendor. Tumor volume, HPV status, and two radiomics covariates were selected for the CT model, resulting in an AUC of 0.72. However, volume alone produced a higher AUC, whereas adding radiomics features reduced the AUC. HPV status and one radiomics feature were selected as covariates for the PET model, resulting in an AUC of 0.59, but neither covariate was significantly associated with survival. Limiting the training and independent testing to patients with the same imaging protocol reduced the AUC for CT patients to 0.55, and no covariates were selected for PET patients. Radiomics features were not consistently associated with survival in CT or PET images of head and neck patients, even within patients with the same imaging protocol.